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Abstract 

Network reconstruction is the first step towards understanding, diagnosing and controlling the 
dynamics of complex networked systems. It allows us to infer properties of the interaction matrix, 
which characterizes how nodes in a system directly interact with each other. Despite a decade 
of extensive studies, network reconstruction remains an outstanding challenge. The fundamental 
limitations governing which properties of the interaction matrix (e.g., adjacency pattern, sign pat¬ 
tern and degree sequence) can be inferred from given temporal data of individual nodes remain 
unknown. Here we rigorously derive necessary conditions to reconstruct any property of the inter¬ 
action matrix. These conditions characterize how uncertain can we be about the coupling functions 
that characterize the interactions between nodes, and how informative does the measured temporal 
data need to be; rendering two classes of fundamental limitations of network reconstruction. Coun¬ 
terintuitively, we find that reconstructing any property of the interaction matrix is generically as 
difficult as reconstructing the interaction matrix itself, requiring equally informative temporal data. 
Revealing these fundamental limitations shed light on the design of better network reconstruction 
algorithms, which offer practical improvements over existing methods. 
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Networks are central to the functionality of complex systems in a wide range of fields, 
from physics to engineering, biology and medicine met When these networks serve as 
conduit to the system dynamics, their properties fundamentally affect the dynamic behav¬ 
ior of the associated system; examples include epidemic spreading HE!, synchronization 
phenomena pm, controllability [8, 2] and observability [TO]. For many complex networked 
systems, measuring the temporal response of individual nodes (such as proteins, genes and 
neurons) is becoming more accessible m- Yet, the network reconstruction (NR) problem 
—that is, recovering the underlying interconnection network of the system from temporal 
data of its nodes— remains a challenge HM3]. Consider a networked system of n nodes. 
Each node is associated with a state variable Xi(t) G R, i = 1, • • • , n, at time t that may 
represent the concentration of certain biomolecule in a biochemical system, the abundance 
of certain species in an ecological system, etc. The time evolution of the state variables is 
governed by a set of ordinary differential equations: 

n 

Xi(t) = y; dijfij (xi(t),xj(t)) + Uj(t), i = (i) 

3 = 1 

Here the coupling functions f %] : 1x1 -> 1 specify the interactions between nodes - 
self interactions when i — j, or pairwise interactions between nodes when i ^ j. The 
term Ui(t) G R represents known signals or control inputs that can influence the i-th state 
variable. The interaction matrix A = (a^-) G R nxn captures the direct interactions between 
nodes, naturally defining the interconnection network of the system by associating to the 
link j —X i between node i and node j. By appropriately choosing the coupling functions, 
Eq. (|T|) can model a broad class of networked systems [2j. Given some function V of the 
interaction matrix —which we call a property — NR aims to recover the value of V{A) from 
given temporal data {xi(t), Ui(t)}f =1 , Wt G and given uncertainty of the coupling 

functions. 

Note that the classical parameter identification (PI) problem for ([TJ) aims to recover the 
interaction matrix itself (i.e. reconstructing the identity property) [T51 - fT7] . But in many 
cases, instead of reconstructing A itself, we may want to reconstruct properties like its sign 
pattern S = [%] = [sign(a^)] G { —l,0,l} nxn , connectivity pattern C = [cif] = [|s^|] G 
{0, l} nxn , adjacency pattern K = [kif] = [cy( 1 — %)] G {0,l} nxn (<j l3 is the Kronecker 
delta) or in-degree sequence d = [df\ = [J2j c v\ e Indeed, a key insight of network 
science is that important properties of networked systems —such as sign-stability, structural 
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controllability/observability and epidemic thresholds— can be determined from S, C, K 
or d without knowing A @hei m hhm. Note that these properties cannot be easily 
reconstructed by computing correlations in the data, simply because correlations capture 
both direct and indirect interactions. 

NR helps us understand, diagnose and control the dynamics of diverse complex networked 
systems, deepening our understanding of human diseases and ecological networks, and letting 
us build more resilient power grids and sensor networks Yet, despite a decade 

of extensive studies, NR remains an outstanding challenge nn da EE]. Many existing 
algorithms do not perform significantly better than random guesses mm, and even well- 
established methods can provide contradictory results for relatively simple networks H- 
It has been realized that these problems originate from our ignorance of the fundamental 
limitations of network reconstruction, governing which properties of the interaction matrix 
can be recovered from given temporal data and knowledge of the coupling functions mm- 
Indeed, it is still unclear if an NR algorithm fails to recover the correct value for V(A) due 
to some design flaws, or due to limitations intrinsic to the available temporal data and/or 
our uncertainty about the coupling functions. Furthermore, it is also unclear if NR can be 
solved with less informative data that that is necessary to solve the classical PI problem. 
Our intuition suggests that NR is easier (in the sense of requiring less informative temporal 
data) than PI simply because we are recovering less information (e.g. K instead of A). But, 
is this true? 

Here we characterize the fundamental limitations of NR for the first time, by deriving 
necessary (and in some cases sufficient) conditions to reconstruct any desired property of 
the interaction matrix. We find that fundamental limitations arise from our uncertainty 
about the coupling functions, or uninformative temporal data, or both. The first class of 
fundamental limitations is due to our uncertainty about the coupling functions, rendering a 
natural trade-off: the more information we want to reconstruct about the interaction matrix 
the more certain we need to be about the coupling functions. To show this, we characterize 
necessary conditions that our uncertainty about the coupling functions needs to satisfy in 
order to reconstruct some desired property of the interaction matrix. For example, we 
show that it is possible to reconstruct the adjacency pattern K without knowing exactly 
the coupling functions. But, in order to reconstruct the interaction matrix A itself, it is 
necessary to know these functions exactly. Hence, if we are uncertain about the coupling 
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functions, NR is easier than PI. 

The second class of fundamental limitations originates from uninformative data only, 
leading to a rather counterintuitive result: regardless of how much information we aim 
to reconstruct (e.g. edge-weights, sign pattern, adjacency pattern or in-degree sequence), 
the measured data needs to be equally informative. This happens even if we know the 
coupling functions exactly. We prove that the same condition (| 6 ]) on the measured data is 
generically necessary regardless of the property to be reconstructed. Hence, in the sense of 
informativeness of the measured data, reconstructing any property of the interaction matrix 
is as difficult as reconstructing the interaction matrix itself, i.e. NR is as difficult as PI. In 
order to circumvent this limitation without acquiring more temporal data (i.e. performing 
more experiments), we show that prior knowledge of the interaction matrix is extremely 
useful. 

These two classes of fundamental limitations indicate that when we are uncertain about 
the coupling functions (true for many complex systems) PI is impossible, but we can still 
reconstruct some properties of the interaction matrix A provided the measured temporal 
data is informative enough and interactions are pairwise. In this sense, NR is easier than 
PI. Yet, ironically, even if we are completely certain about the coupling functions, with less 
informative data NR does not allow us to do more —it is as difficult as PI. 

I. RESULTS 

A property V(A) can be reconstructed if and only if (iff) any two interaction matrices 
Ai, A 2 G M. nxn with different properties V(Ai) 7 ^ V{^A^ produce different node trajectories 
{xj(t)}" =1 , t G [hnH], a notion of identifiability or distinguishability [ 15] . 

We study the distinguishability of the interaction matrix by defining the interconnection 
vector of node i as a* = (aa, ■ • • , a; n ) T G M n , which is just the transpose of A’s i-tli row. We 
also define the regressor vector fi(x) = ( fn(xi , x±), • • • , fi n {xi,x n )) J of node i, characterizing 
the coupling functions associated to node i. Then (|TJ) can be rewritten as 

Xi{t) = fi{x(t))a,i + Ui(t), i = l,---,n. (2) 

with x — (x±, ■ ■ ■ , x n ) J G M n the state vector. Using this notation, the distinguishability of 
V(A) is equivalent to the distinguishability of P(cq) for i — 1 , • ■ ■ ,n. 
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a. Indistinguishability due to unknown coupling functions 


b. Indistinguishability due to uninformative data 
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FIG. 1. Two sources of indistinguishability. a. The same dynamics can be characterized by 
two regressors with different coupling functions (purple and green), yielding indistinguishable net¬ 
works that differ in their edge-weights, sign patterns, connectivity patterns and degree sequences, 
b. With the classical population dynamics described by the generalized Lotka-Volterra (GLV) 
model j'i = riXi + a Vj X{X yi the two different networks shown in the top panel —representing 
two different inter-species interaction matrices— produce identical node trajectories x(t) (bot¬ 
tom panel). Here the growth rate vector is r = (0, —0.5, 0.5, —0.5, 0) T and initial abundance 
*(0) = (0.895349,0.72093,0.255814,1.82558,1.82558) 1 . In these two examples, it is impossible to 
reconstruct the edge-weights, sign-pattern, connectivity-pattern or degree sequence of the network 
simply because we cannot decide which one of the two networks produced the measured node 
trajectories. 


In many cases, due to our lack of knowledge of the exact coupling functions, we may 
not know the true regressor f t but only a family of regressors {/*} to which it belongs. 
Members of the family can be considered as deformations ffx) = g,if t (x)) of the true 
regressor fi(x) obtained by applying some transformation g, : M n — > M n . This family can be 
characterized by a set G* of admissible transformations, specified as follows: (i) this set is a 
group m, and (ii) any gi E G* is a continuous function that preserves pairwise interactions. 
Consider also the group G* Mn of linear transformations that preserve pairwise interactions. 
These linear transformations can be associated with nonsingular matrices GJ E M nxn with 
nonzero entries only in its diagonal and i-th column (see FigjT^, and SI-2). Let G, n n denote 
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the transpose of G* Nn , i.e. Gi G G,;jj n if and only if GJ G G* Nn . Hereafter we use the following 
observation: since G* )in cG*,a necessary condition to reconstruct a property when g t G G* 
is that it can be reconstructed when g, G G* iin . Consequently, in order to characterize the 
fundamental limitations of network reconstruction, we can focus on linear transformations 
only. We will show that linear transformations are enough to produce severe limitations in 
the properties that can be reconstructed. Using the notion of structural stability, we later 
discuss the effects of deformations that do not belong to G*. 


A. Indistinguishable interconnection vectors 


Two candidate interconnection vectors Vi,v 2 G M” will be indistinguishable if they pro¬ 
duce the same right-hand side in Eq. ([2]) for some regressor in the family {/*}. This is 
equivalent to the condition 


fi( x (t))v 1 = fJ(x(t))GiV 2 , Vt G [t 0 ,U], (3) 

for some matrix Gi G Ggin, where x(t) is the measured node trajectories. Multiplying this 
equation by fi(x(t)) from the left and integrating over the time interval [£ 0 ,£i] we obtain 


Mj(£ 0 ,U)Oi - GiV 2 ) = 0, 


( 4 ) 


where Mj(t 0 ,£i) = f} ( ' fi( x {t))fi( x (t)) d£ is a constant n x n matrix. It is obvious that Q 
implies Q, but the converse implication is not so obvious (Proposition 1 of SI-3). Indeed, 
it constitutes the main obstacle to extend our analysis to more general uncertainty of the 
coupling functions. Hereafter we write M t instead of Mj(£ 0 ,ti), unless the specific time 
interval is important for the discussion. From Q, the set of all pairs of indistinguishable 
interconnection vectors for node i is given by 


fii = j(v 1; v 2 ) 


x 


3 Gi G G * jin such that (iq — GiV 2 ) G kerM* 


( 5 ) 


The above equation shows two sources of indistinguishability, rendering two classes of 
fundamental limitations of NR. First, unknown coupling functions causes two vectors to be 
indistinguishable if they can be transformed to each other via some Gi G Gjjj n . This set of 
indistinguishable vectors {(vi, u 2 )|ui = GiV 2 ,Gi G Gj.iin} is then the partition O t of M n by 
the orbits of the group G z jj n [30], Fig. [2^, and SI-2. An orbit is called low-dimensional if its 
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dimension is < n (purple, blue, green and brown orbits in Fig.2a). The orbits in Fig|2^ show 
that unknown coupling functions allow us to distinguish only if iq depends on x 3 for j ^ i (i.e. 
the adjacency pattern of the interconnection vector), see Proposition 2a and Example 1 in 
SI-5. This is a consequence of the invariance of the adjacency pattern to the transformations 
in G* (i.e. prior knowledge of the coupling functions). Other properties like edge-weights, 
connectivity patterns or degree sequence are indistinguishable and cannot be reconstructed 
(Proposition 2b in SI-5). Second, even if ffix) is exactly known, indistinguishability can 
still emerge due to uninformative data (Fig. lb), making iq indistinguishable from v 2 if 
Vi — v 2 E k er Mi and kerMj is nontrivial (i.e. contains a linear subspace different from 0). 
In other words, the endpoints of V\ and v 2 can be connected by an hyperplane parallel to 
ker Mi, Figj2jo. Note that hyperplanes parallel to ker Mi are often called fibers of the quotient 
space W 1 / ker Mj. 

Combining these two sources of indistinguishability, iq is indistinguishable from v 2 iff 
it is possible to transform v 2 using an element of Gjjj n in a way that the line (or more 
generally, hyperplane) passing trough iq and G ii ii n 'u 2 is a fiber. Consequently, orbits of Gjjj n 
intersected by a fiber of M n / kerMj become indistinguishable and we can ‘glue’ them together 
to form a partition C\ kerMi of M n into sets of indistinguishable interconnection vectors, Fig. 
[ 2 J 3 . If kerMj is not contained in low-dimensional orbits, then o\ erMi = M n and all vectors 
are indistinguishable. If, however, kerMj is contained in low-dimensional orbits then we 
can reconstruct the adjacency pattern of the interaction matrix (right panel of Fig. 2c). 
Note that the partition of indistinguishable interconnection vectors due to the nonlinear 
deformations cannot be finer than G kerMi obtained via linear deformations. 

Note also that the matrix Mj in Q is typically unknown because the true regressor /j is 
unknown. Certainly, choosing any regressor = Gjf j, Gj G Gj^n, we can only compute 

Mfit 0 ,ti)= ! fi(x(t))f?(x(t))dt = G}Mi(t 0 ,ti)Gi. 

Jto 

Therefore, we have only access to properties of Mi that remain invariant under GjMjGj for 
any Gj G Gj^n. To find those invariant properties, note that if v G kerMj then v = G L v G 
kerMj, since 0 = Mjh = GjMiGiV and G J has full rank. Thus, Gjjj n transforms kerMj into 
kerMj (and vice-versa, because it is a group), and we can only know the orbit Gj i n n (kerMj) 
corresponding to this subspace. For example, the condition kerMj = {0} for some Gj G G t j[ n 
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implies that 


ker Mi = {0}, 


( 6 ) 


because Gj| in (0) = 0 (i.e., 0 = Gi 0 for any Gj). This shows that we can tell if M* is 
nonsingular using any M*. Equation ([6]) is an important condition in system identification 
literature known as Persistent Excitation (PE) and it is necessary and sufficient to solve 
the classical PI problem [31]. With (|6]) the data is informative enough in the sense it does 
not produce indistinguishability. In general, we can build the partition of indistinguishable 
vectors using any M. u i.e., = C>} erMi ( see Lemma 1 of SI-6 for the proof). 

B. Necessary condition to distinguish a property 

Let V : ME —> Y be the property of the interconnection vector we want to reconstruct, 
where Y is its image. For example, Y = {—1,0, l} n if V is the sign pattern, or Y = {0, l} n 
if V is the adjacency or connectivity pattern. The property V can be reconstructed only 
if any two interconnection vectors V\,V2 € M n that have different properties y\ = V{v\) ^ 
V{v 2 ) = y 2 are distinguishable, i.e., belong to different orbits of G,} erMi . Let P y = V^ 1 (y) = 
{u e M n |7 :, (u) = y}. Then V(a,i) can be reconstructed only if all two sets in the collection 
C'p = {P y C M n |y G Y} belong to different orbits Q^ erM \ When the deformations are 
a-priori known to be linear, this condition is also sufficient. 

C. The role of our knowledge of the coupling functions 

We could shrink or enlarge the group of transformations Gj || n according to our uncertainty 
of the coupling functions. For example, it will collapse to the single element Gjj in = {I nxn } 
if we know the coupling functions exactly, or will increase to Gj ; |j n = {nonsingular M nxn 
matrices} if we do not have any knowledge of them. We emphasize that if G;jj n is en¬ 
larged (e.g., by including nonlinear transformations or more general interactions between 
nodes), existing orbits may merge but new orbits cannot appear because the original linear 
transformations preserving pairwise interaction remain in the group. 

Since our previous analysis only depends on the group property of the transformations, 
it can be straightforwardly extended to any linear group G,. It is just necessary to find its 
orbits Oi and build the corresponding Q^ erM \ From this observation, in order to reconstruct 


some property of the interaction matrix, it is necessary that (i) our uncertainty about the 
coupling functions is small enough (i.e., any two sets in Cp belong to different orbits of 
Gj), and (ii) the measured temporal data is informative enough (i.e., hyperplanes parallel 
to G.;(kerMj) do not glue orbits together). For example, in order to reconstruct the edge- 
weights it is necessary to know the coupling functions exactly (G* = {/}), because only then 
any two vectors belong to different orbits. 


D. Specifying the coupling functions 

It is possible to reduce G; to {/} when the system we aim to model indicates the appro¬ 
priate coupling functions to use. For example, the generalized Lotka-Volterra (GLV) model 
can provide a good starting point for ecological systems [lH]. Linear coupling functions are 
appropriate if the system remains close to an operating point (e.g., a steady-state). Can¬ 
didate coupling functions for the model can also be computationally searched or improved 
using symbolic regression [32] . In these cases indistinguishability emerges only from uninfor¬ 
mative data: V\ is indistinguishable from V2 iff V\ — V2 E ker Mi. Consequently, a property 
V(a,i) can be reconstructed iff all two sets in the collection Cp = {P y C M n |?/ e Y} can be 
separated by a fiber, Fig. SI. A fiber is an hyperplane and thus partitions M n in two regions; 
we say it separates P yi from P y2 if P yi belong to one region and P m belongs to the other 
region or the fiber, Fig. 2b. 

By specifying the coupling functions we can reconstruct more information such as the 
interaction matrix itself (i.e., edge-weights). Setting V = Identity we obtain Cp = M n , 
showing that the necessary and sufficient condition to reconstruct A is to distinguish between 
any two different interconnection vectors in M n . This is possible iff the PE condition (J6]) 
holds, a classical result from system identification theory [31]. Without PE it is still possible 
to distinguish, for example, the adjacency-pattern of the interconnection vector when kerM; 
is exactly ‘horizontally’ oriented. I 11 fact, from the right panel of Fig. 2c, we can separate 
the sets P y of vectors with different adjacency-patterns (orange and red regions) using the 
same red region as separating fiber. However, this situation is pathological in the sense 
that an infinitesimal change in the fiber’s orientation will eliminate the distinguishability. 
Note also that other properties like sign-pattern, connectivity pattern or degree sequence 
are indistinguishable. 
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E. Persistent excitation is generically necessary 


Any mathematical model only approximates the dynamic behavior of a real system. 
Therefore, we can only expect that the “true” coupling functions are sufficiently close (but 
not exactly equal) to some deformation fi(x) = Gjfi(x), Gi G G i; |j n . Considering this, it 
is important to understand if the distinguishability conditions derived earlier remain true 
under arbitrary but sufficiently small deformations of the coupling functions, a notion known 
as structural stability [331 [M] . Otherwise, these conditions represent non-generic cases that 
cannot appear in practice because they vanish under infinitesimal deformations. 

We proved that the PE condition (J6| is structurally stable (Theorem 1, SI-7). How¬ 
ever, when kerMj is non-trivial, the condition that it belongs to low-dimensional orbits is 
structurally unstable (Theorem 2, SI-7). To understand the implications of these results, 
let’s consider an arbitrary deformation fj{x) with ‘size’ 5 > 0, i.e., || f; L (x{t)) — fi(x(t ))|| < 
5, Wt G [to, ^i]- The PE condition is structurally stable because there exists 5 > 0 sufficiently 
small such that if fi(x(t)) has PE then any fi(x(t )) also has PE, Fig.3a. Indeed, regardless 
of the size of the deformation, almost any analytic deformation of the regressor will also 
have PE (Theorem 3, SI-8). In practice, these two results imply that we can check if given 
temporal data satisfies the PE condition without knowing the coupling functions exactly. 
In contrast, when kerMj is non-trivial (i.e., contains a linear subspace of M n different from 
0 ) and belongs to low-dimensional orbits, then for any S > 0 there is a deformation fi(x) 
—a rotation, indeed— such that kerMj belongs to the n-dimensional orbit, Fig.3b. Here 
Mi = Jl 1 fi(x(t))fl(x(t))dt. 

The analysis above shows that only two generic cases exist: (i) kerMj = {0} and in¬ 
distinguishable vectors emerge only due to uncertain coupling functions 0\ erMi = Of, and 
(ii) kerMj is not trivial and is contained in the n- dimensional orbit, so all interconnection 
vectors become indistinguishable o\ erMi = M n . 

Consequently, in a generic case, the PE condition ([6]) is necessary in order to reconstruct 
any property. Even if the coupling functions are exactly known, without PE we cannot 
generically reconstruct the sign/connectivity/adjacency patterns or degree sequence. The 
reason is simple: for all these properties there is no gap between the sets Cp. For example, 
for £«0, the vectors V\ = (e, 0, • • • , 0) T and V 2 = 0 are infinitesimally close in M n but have 
different connectivity or degree sequence. Therefore, even when the sets P y can be separated 
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by a fiber with a particular orientation (e.g, P yi and P m shown in Figj^), an infinitesimal 
deformation in the coupling functions changes this orientation producing indistinguishable 
interconnection vectors with different properties. The question is how to create these gaps 
and solve NR problems without PE. 

In the following, we show that knowing prior information about the interaction matrix A 
shrinks the domain of a property V, create gaps between the sets P y in C-p and hence relax 
the PE condition. 

F. Prior knowledge of the interaction matrix relaxes the PE condition 

For clarity, in this section we assume that the coupling functions are exactly known. The 
simplest prior information of A is that the interconnection vectors satisfy: 

di e V, i = 1, • , 71 , (7) 

where V C is a known set. Prior information shrinks the domain of the property V from 

R n to V, i.e., V : V C M n —y Y. Two typical cases are: (i) a t] takes a finite number of values 

(e.g., binary signed interactions) and V = U y P y is a discrete set since each P y is a point, 
Fig.4a; and (ii) are bounded as 

U j ij £ [ ®maxi ®min] U [ d U [o m in; ®max] (8) 

for some known constants 0 < e < a m i n < a max . In this case V = U y P y , where Pq is an 

e neighborhood of zero (which can be associated to ‘zero’ sign-pattern), and each of the 
3 n — 1 remaining sets lies in a different orthant MA (and thus be associated to distinct sign 
patterns), see Fig.4b. A similar analysis can be applied in the case when ‘network sparsity’ 
is the prior information, SI-9. 

In case (i), A itself can be reconstructed without PE if we can separate each point 
composing V with a fiber. If dim(kerMj) < n, this is generically possible because an 
infinitesimal deformation will change any ‘pathological’ orientation that contains two points. 
In case (ii), the sign or connectivity pattern can be reconstructed without PE if there is a gap 
between the sets P y such that a fiber can separate them, Fig.4b. The condition that a fiber 
fits in a gap is structurally stable. If this gap increases (a m i n — e increases and a max — a m \n 
decreases), it becomes even easier for the fibers to fit. However, the interaction matrix A 
itself cannot be reconstructed because it is impossible to separate two points inside one P y . 
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G. Example 


We illustrate our results in a basic problem of network reconstruction using steady-state 
data. Consider two species (xi,x 2 ) interacting in a food web and suppose we measure their 
steady-state abundances x{t) = const, Vf G [to,ti]- The goal is to reconstruct the sign- 
pattern of the interaction matrix characterizing who eats whom. Since the data is constant, 
any regressor fi(x(t )) is also constant and all Mis have rank 1 at most. Thus, the PE 
condition cannot be satisfied. Consequently, our analysis shows that without better 
specifying the coupling functions of the model, all interconnection vectors are generically 
indistinguishable and it is impossible to reconstruct any property of the interaction matrix. 

To circumvent this problem we specify the coupling functions using the GLV model iy = 
TiXi + E?=i CLijXiXj. We assume that the growth rates r t are known. This uncontrolled model 
can be rewritten as in (JTj) using fij(xi,Xj ) = x^Xj and tq(f) = TiXiit). Note that Mi(t 0 ,ti) = 
xf ■ (ti — t 0 ) ■ xx 1 has rank 1 at most, and it is still generically impossible to reconstruct 
exactly the interaction matrix A = (a, :j ) or any other property of it. This coincides with the 
fact that one steady-state experiment is generically not enough for parameter identification 
[35]. Yet, assuming known bounds of the interactions ([8]), we can reconstruct exactly the 
sign-pattern. For this, it is necessary and sufficient to separate the 3 2 sets in C-p by lines 
parallel to k er Mi. SI-10 presents a numerical example when this is possible, and SI-4 shows 
an NR method based on our analysis. 


II. DISCUSSION 

We now discuss the implications of our results. Regardless of the property of the inter¬ 
action matrix A we aim to reconstruct and even if we know the coupling functions exactly, 
we proved that PE (|6|) is generically necessary. This fundamental limitation implies that 
reconstructing less information of the interaction matrix generically does not mean we can 
solve an NR problem with less informative data. In particular, when only steady-state data 
from a single experiment is available, our result implies that generically no property of the 
interaction matrix can be reconstructed, not even mentioning the interaction matrix itself 

[35] . From a different angle, the PE condition also serves as guideline to design experiments 

[36] that can provide sufficiently informative data. For instance, simply changing the initial 
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conditions of the two-species ecological network of our previous example can produce PE 
using the GLV model. Available control inputs and intrinsic noise on the dynamics are also 
useful for this [ 371 135 ]. Notice that in system identification literature PI is often performed 
in real time, so the PE condition should hold uniformly in the initial time [16, 17| l3Ti] . 

The advantage of using NR to reconstruct less information of the interaction matrix is 
that we can have more uncertainty about the system dynamics. For example, if we aim to 
reconstruct the adjacency-pattern K and the PE condition holds, we can consider the set 
of all dynamic systems with pairwise coupling functions and we need little knowledge of the 
true system dynamics. We can check the PE condition even when the coupling functions 
are not exactly known (SI-7 and SI-8). Indeed, for linear deformations, we characterized 
an optimal tradeoff: given a property of A to reconstruct, the uncertainty on the coupling 
functions should be small enough (orbits distinguish the property) and the measured data 
should be informative enough (to ensure PE in the family of regressors). It remains open 
to understand how much indistinguishability is created by considering general nonlinear 
deformations. 

Experimentally measured data usually has poor information content, in the sense that it 
typically cannot satisfy the PE condition. For example, current gene sequencing is frequently 
constrained to measure steady-state data only, which cannot satisfy the PE condition for 
any regressor. In order to circumvent this fundamental limitation of NR, we have shown 
that prior knowledge of the interaction matrix can relax the PE condition allowing us to 
solve the NR problem. 

We notice that a different class of fundamental limitation in NR has been discussed in 
literature: solving an NR problem is impossible without measuring all time-varying nodes 
in the network [39] . If the state variables of unmeasured nodes are constant, then NR is ac¬ 
tually possible (SI-11). Previous works considered the distinguishability of the parameters 
themselves only (i.e., the identity property) and were restricted to known coupling func¬ 
tions mm- Our analysis characterizes necessary conditions to distinguish any property 
of the interaction matrix under uncertain coupling functions, and it can be straightfor¬ 
wardly extended to include arbitrary-order interactions (e.g., XiXjXk ) and some nonlinear 
parametrizations (e.g., ay/(a^ + Xj)), SI-12. The analysis of uncertain coupling functions 
is motivated by existing NR algorithms that completely ignore our knowledge about the 
system dynamics, [TO] and references therein. It is also possible to analyze the effect of 
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noise and more general uncertainty of the coupling functions at the cost of less constructive 
results [ iT . 

Our results indicate that a better characterization of the uncertainty in the system’s 
coupling functions and prior information of the interaction matrix are extremely useful to 
make practical improvements in network reconstructions. This, in turn, calls for the design 
of better algorithms (SI-4) that incorporate such information, and that provide a guarantee 
of correct network reconstruction. 
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a. Indistinguishability due to unknown coupling functions 

interconnection vector a* G R 2 interconnection vector a* E R 3 




V 3 

Vi 

V 2 


vectors in the same orbit (regions with the same color) 
are indistinguishable 


b. Indistinguishability due to 
uninformative data 


fiber ai 3 



indistinguishable vectors are 
joined by a fiber 


c. Combined indistinguishabiltiy _ 

all vectors are the adjacency-pattern is 

indistinguishable distinguishable 



orbits are glued if intersected by a fiber 


FIG. 2. Indistinguishability of interconnection vectors, a. Indistinguishable vectors due 
to unknown coupling functions can be transformed into each other using some transformation 
Gi G Gjjin. Sets of those indistinguishable vectors are the partition of W 1 by the orbits O t of Gjjj n , 
here shown in different colors for n = 2 and n = 3. Purple regions should be interpreted as points, 
and blue regions as lines. The grey region is another orbit. We can distinguish an interconnection 
vector in the blue orbit (e.g., V 2 with component aij = 0 ) from an interconnection vector in the 
orange orbit (e.g., V\ or V3 with component djj 7 ^ 0), illustrating that we can distinguish the 
adjacency of the interconnection vector (i.e., wether a t] is zero or not for j 7 ^ i). Nevertheless, 
since V\ and V3 belong to the same orbit and hence are indistinguishable, but they have different 
degree sequences and sign or connectivity patterns, these properties cannot be reconstructed, b. 
Due to uninformative measured temporal data, the interconnection vector v\ is indistinguishable 
from V 2 because V\ — V 2 6 ker Mj, that is, both vectors are joined by a fiber (shown in red). 
Note also that we can separate the sets P yi and P y . 2 with the particular orientation of the fibers. 
However, since there is no gap between these sets, any change in the orientation of the fibers 
(regardless of how small it is) will produce indistinguishable interconnection vectors that belong 
to different sets. This illustrates that the PE condition remains generically necessary if there is 
no gap between the sets in C-p = {'P~ 1 (y) C V |y 6 Y}. c. Indistinguishable vectors in network 
reconstruction appear by combining both kinds of indistinguishable vectors, gluing together orbits 
of Gj ii n when they are intersected by a fiber of M n /kerMj. In the left panel, since kerMj is not 
contained in low-dimensional orbits, all orbits are are glued (P ker Mi = M 2 and all vectors become 
indistinguishable (e.g., v\ is indistinguishable from V3). In the right panel, kerMj is horizontally 
oriented and hence contained in low-dimensional orbits. We can then distinguish between V2 and 
V3 and hence reconstruct the adjacency pattern of the interaction matrix. 
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a. Persistent Excitation is structurally stable and generic 

space of 
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deformed regressor 
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deformation 
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b. Structurally unstable 
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interactions has PE 
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low-dim orbit 


FIG. 3. Schematic illustration of structural stability, a. The Persistent Excitation condition 
Q is structurally stable because once some regressor fi has PE, any small enough deformation fi 
of it also has PE. b. When kerM, is nontrivial, the condition that it belongs to low-dinrensional 
orbits is structurally unstable because there always exists a infinitesimal deformation fi such that 
kerMj belongs to the n-dimensional orbit. 




FIG. 4. Prior information of the interaction matrix relaxes the PE condition, a. 

When the edge-weights aif s take a finite-number of values, the set V is discrete (shown in grey). 
Then distinguishability of the edge-weights is generic, because an infinitesimal deformation will 
change any fiber that contains two elements of V (grey points), b. Example for the sets P y (shown 
in grey) in the case of known bounds of the edge-weight ([8]). Though the edge-weights cannot 
be distinguished, the sign-pattern (and connectivity) can still be distinguished since there exist 
hyperplanes parallel to kerM; (shown in blue) separating every P y . This condition is structurally 
stable. 
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